Object-Oriented Conceptual Modeling of Video Data

In this paper, we propose a graphical data model for specifying spatio-temporal semantics of video data. The proposed model segments a video clip into subsegments consisting of objects. Each object is detected and recognized, and the relevant information of each object i s recorded. The motions of objects are modeled through their relative spatial relationships as t ime evolves. Based on the semantics provided b y this model, a user can create his /her own object-oriented view of the video database. Using ihe propositional logic, we describe a methodology f o r specifying conceptual queries involving spatio-temporal semantics and expressing views f o r retrieving various video clips. Alternat ively , a user can sketch the query, by examplifying the concept. The proposed methodology can be used t o specify spatio-temporal concepts at various levels of information granularity.